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Abstract 



In this paper, we describe the results a study assessing the relationship between the certification 
of teachers by the National Board for Professional Teaching Standards (NBPTS) and elementary- 
level student achievement. We examine whether NBPTS assesses the most effective applicants, 
whether certification by NBPTS serves as a signal of teacher quality, and whether completing the 
NBPTS assessment process serves as catalyst for increasing teacher effectiveness. We find 
consistent evidence that NBPTS is identifying the more effective teacher applicants and that 
National Board Certified Teachers are generally more effective than teachers who never applied 
to the program. The statistical significance and magnitude of the “NBPTS effect,” however, 
differs significantly by grade level and student type. We do not find evidence that the NBPTS 
certification process itself does anything to increase teacher effectiveness. 

(JEL Classification #120: Education- General) 
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I. Introduction 

Education research has failed to reach a consensus over which, if any, readily identifiable teacher 
characteristics are associated with students’ learning gains, and it remains an open question as to 
whether it is even possible to judge teachers’ effectiveness using measures other than direct 
observations of their teaching. From a policy perspective this is extremely problematic: state- 
level policymakers lack the knowledge they need to make informed decisions about teacher 
licensure, and local policymakers lack information that might be useful in hiring teachers and 
determining compensation. The National Board for Professional Teaching Standards (NBPTS) 
offers the potential to address some of these issues through the creation of a voluntary 
certification process whereby teachers who are considered to be highly effective can 
demonstrate, and gain recognition for, their knowledge and teaching .s ki lls.^ 

In both its scope and expense, NBPTS is arguably the most significant national 
development in teacher policy in the last two decades. Participation in the NBPTS program has 
grown dramatically over a relatively short period of time: the National Board certified fewer than 
200 teachers in 1993-94, but by November, 2005, this figure had climbed to more than 47,500.^ 
The program is supported by substantial investments from all levels of government as well as 
private sources including a substantial number of teachers themselves. NBPTS currently reports 
federal ($149.1 million) and private ($261 million) funding of $410.1 million.^ In addition to 
this, NBPTS receives a fee ($2300 in 2005) for every application, which is paid for either by 
teachers or, in many cases, by states and localities. Based on an estimated 100,928 applicants 
(from 1993-94 through 2004-05), this is an additional investment of $227.3 million, putting the 
total investment in the NBPTS program at upwards of $637 million."^ 
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In addition to this direct support of the National Board program, some states and 
localities offer salary supplements to National Board Certified Teachers (NBCTs).^ In North 
Carolina, for instance, NBCTs receive a 12 percent increase in their base pay. In California 
NBCTs who opt to teach in a “high-priority” school for four years are eligible to receive a 
$20,000 merit award. ^ While these examples certainly represent the more generous of the direct 
financial incentives provided to NBCTs, many districts provide other types of incentives (e.g., 
release time or preparation assistance) that are also costly but more difficult to quantify. 

NBPTS offers the potential to address long-standing concerns about teacher quality in at 
least two ways. First, NBPTS certification may serve as a signal of effectiveness that schools or 
districts may use to identify skilled teachers for leadership roles or critical teaching positions. 
The recognition, and often rewards, that accompany the NBPTS credential may also encourage 
more effective teachers to remain in the teaching profession longer than they otherwise would. 
Second, the NBPTS certification process itself, which requires applicants to engage in “intense 
self- reflection and analysis” of their own teaching, may serve as a catalyst for effective teaching 

n 

by helping to build the human capital of teachers. 

While many advocates of NBPTS embrace both the “signal” and “catalyst” hypotheses 
about the program’s benefits, critics argue that there is little evidence to support either view and 
question the significant investments that have been made in the program (Finn 2003). Because 
there is surprisingly little quantitative evidence to inform the debate about the program’s effects, 
it certainly remains an open question as to whether policymakers should consider NBPTS as a 
good signal of teacher quality or a productive way to build the human capital of teachers. 

In this paper we hope to inform the debate by presenting the results of the first large-scale 
study of the program and its relationship to student achievement. Using a unique data set from 
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North Carolina, we explore both the “signal” and “catalyst” hypotheses about the program’s 
effects. In short, we consistently find that NBPTS certification is successfully identifying 
effective teachers: NBPTS -certified teachers are more effective than unsuccessful NBPTS 
applicants and generally more effective than teachers who never applied to the program. The 
statistical significance and magnitude of the “NBPTS effect,” however, differs significantly by 
grade level and student type. We do not, however, find evidence that the NBPTS certification 
process itself increases teacher effectiveness. 

The paper is laid out as follows: Section II provides some background information on 
NBPTS, as well as a brief overview of the research literature on the relationship between various 
teacher characteristics and student outcomes. Section III describes the data and analytic methods 
we used in the study, and Section IV presents our results. Section V offers policy implications of 
our findings and some conclusions. 

II. Teacher Quality and NBPTS 

A growing body of research shows that the quality of the teacher in the classroom is the most 
important schooling factor predicting student outcomes (e.g., Ferguson 1998; Goldhaber 2002; 
Goldhaber et al. 1999; Hanushek et al. 1999; Wright et al. 1997). Furthermore, the impact of 
having a high-quality teacher can be profound. Hanushek (1992), for instance, finds that, all else 
equal, a student with a very high quality teacher will achieve a learning gain of 1.5 grade level 
equivalents, while a student with a low-quality teacher achieves a gain of only 0.5 grade level 
equivalents. Thus, the quality of a teacher can make the difference of a full year’s learning 
growth. 

While researchers tend to agree that teacher quality is an important determining factor in 
influencing student outcomes, there is little consensus about the relationship between specific 
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teacher credentials (e.g., experience and degree level) and characteristics (e.g., age, race and 
ethnicity), and teacher effectiveness.^ Certain teacher characteristics — a subject- specific master’s 
degree, for example — seem to matter in certain contexts (e.g., high school math), but not in 
others. More to the point, only a small percentage of what makes teachers successful in the 
classroom is associated with characteristics such as degree and experience levels, and 
certification status (Goldhaber 2002; Goldhaber and Brewer 2000; Hanushek 1986, 1997). In 
other words, teachers clearly matter, but teacher quality is not strongly related to observed 
teacher characteristics. There is a seeming contradiction between the fact that teachers have a 
large impact on student achievement but specific teacher attributes are not consistently found to 
directly impact student achievement. This may be credited to the fact that the attributes that 
actually make teachers successful in the classroom (e.g., enthusiasm and ability to convey 
knowledge) are not strongly related to the teacher attributes typically measured in education 
productivity studies.^ 

NBPTS was founded on the idea that the attributes that make experienced teachers 
effective can, in fact, be identified and evaluated. A casual look at the program suggests that 
demonstrated mastery of NBPTS standards represents a significantly higher hurdle than does 
standard state- level licensure. From 1999 through 2002, only about 50 percent of first- time 
NBPTS applicants became certified while about 90 percent of teachers typically pass states’ 
licensure exams (e.g. Praxis I or II) on the first try. Furthermore, research suggests there is a 
strong correlation between an NBPTS applicant’s performance on standardized tests and both the 
probabilities of application and, given application, NBPTS certification (Goldhaber et al. 2004). 
Given that numerous studies find a positive connection between teacher performance on 
measures of academic proficiency and student outcomes, this provides some face validity to the 
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notion that the program is identifying better teachers (Ferguson and Ladd 1996; Goldhaber 2002; 
Greenwald et al. 1996). Of course, these facts are only suggestive. A real test of the value of 
NBPTS as an indicator and/or catalyst for effective teaching requires that we look at a direct 
measure of teacher effectiveness: student outcomes. As NBPTS skeptics often note, to date, such 
evidence is lacking (Ballou and Podgursky 1998; Podgursky 2001). 

Given educational resource constraints and the size of the local, state, and national 
investment in NBPTS, policymakers have reason to be concerned about whether NBPTS 
certification is in fact an effective indicator of teacher quality or has the potential to increase 
teacher effectiveness by building human capital. We are aware of only a limited number of 
studies (Bond et al. 2000; Cavalluzzo 2004; Stone 2002; Vandevoort et al. 2004) that attempt to 
link NBPTS certification status directly to student outcomes. Of these, only Bond et al. and 
Vandevoort et al. have been published in a peer-reviewed journal, and each suffers from serious 
data shortcomings: Bond et al. is based on a sample of 31 NBCTs, while the Vandervoort et al. 
study includes only 35 NBCTs, and neither study includes statistical adjustments for differences 
in student demographics (Vandevoort et al. measures student gains in performance while Bond et 
al. does not). Thus, the available literature on NBPTS has been striking in its absence of rigorous 
quantitative studies that policymakers might use to judge the relative costs and benefits of the 
NBPTS program, despite its potential to identify teaching skills that may relate to student 
learning. As we describe below, our study sample includes longitudinal information on a 
significantly larger sample of students and bachers, which permits the estimation of more 
sophisticated statistical models that account for potential biases associated with the possibility 
that students are nonrandomly assigned to their teachers. 
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III. Analytic Approach and Data 



A. Analytic Approach 

Our metric for measuring the effectiveness of NBCTs utilizes student performance on 

standardized tests administered as part of the North Carolina accountability system.'^ We begin 

1 ^ 

by estimating a basic educational production function of the following form: 

= o.X„ + ^NBPTS„,+ YS„,+V,J„(1) 

The subscripts i, j, s, and t denote individual student, teacher, school/district/community, and 
time, respectively. The left-hand side of the equation {A^■, -A.j^,_y^) is the growth in student test 

score from time (t- 1) to time t. X (from here forward we suppress the subscripts for simplicity) is 
a vector of individual characteristics including student’s race, gender, learning disability, free or 
reduced- price lunch status, English proficiency status, grade, and year. NBPTS is a vector of 
characteristics defining the National Board status of student i’s teacher, and 5 is a vector of other 
teacher, school, and community control variables including the teacher’s race/ethnicity, gender, 
age, license basis and status, degree level, dichotomous variables for various years of teaching 
experience, standardized test scores, school size (number of students), school student -to- teacher 
ratio, fraction of minority students at school, fraction of free or reduced-price lunch at school, 
district size (number of students), the expenditure per pupil in the district, district type (urban, 
suburban, or rural), the percent of education expenditure spent on instruction, the starting salary 
of teachers with a bachelor’s degree in that district, the percent of people with a bachelor’s 
degree in the community, and the median housing value in the community. 

We investigate several hypotheses using the above model. First, by comparing NBCTs to 
non- NBCTs (both noncertified applicants and non- applicants), we examine whether or not 
NBPTS certification is a good signal of teacher quality in the teacher labor market as a whole. 
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From a policy perspective, this comparison is particularly relevant given that the federal 
government has identified NBPTS certification as a tool that states can use to meet the teacher 
quality provisions of the No Child Left Behind Act. Second, we examine whether NBPTS 
certification provides any information about teacher effectiveness that goes beyond what is 
already provided by teacher licensure tests (in other words, are relatively cheap licensure tests 
just as good as NBPTS at identifying effective teachers?). 

Next we examine the question of whether NBPTS is identifying the most effective 
candidates among those who apply for the program by comparing successful and failed 
applicants. NBPTS only makes judgments about those who apply to the program, and evidence 
suggests that the NBPTS applicant pool is quite different from the teacher workforce as a whole 
(Goldhaber et al. 2004). Finally, we investigate the question of whether or not the NBPTS 
certification process itself is a catalyst for building human capital by comparing teacher 

1 7 

effectiveness before and after completing the NBPTS certification process. 

Given our concern that NBCTs may have differential impacts on different types of 
students, and that our findings may be confounded by nonrandom sorting of students across 
teachers (Clotfelter, Ladd, and Vigdor 2003), we also estimate models for different subgroups of 
students and specify models that include school and student fixed- effects. 

B. Data 

The primary source of data for this study is teacher- and student- level administrative records 
from North Carolina’s Department of Public Instruction (NCDPI) for school years 1996-97 
through 1998-99 (in addition, we have information on whether teachers in our sample applied to 

1 o 

the program or became NBPTS -certified through 1999 — 2000). North Carolina is an ideal state 
for studying the effects of NBPTS certification due to the large numbers of NBCTs in the state. 



8 




and because the state accountability system requires yearly testing of students using aligned tests 
to track progress over several years. Furthermore, it is possible with these data to link teacher 

90 

and student records (at the elementary level) and to track both over time. 

The NCDPI teacher records include variables such as teacher’s race/ethnicity, gender, 
age, license basis and status, degree level, years of teaching experience, and a measure of teacher 
academic proficiency — that is, their performance on one or more standardized tests including 
one or more of the following: the Praxis generalist test (Praxis I), Praxis subject tests (Praxis II), 
the National Teacher Exam (NTE), and, in some cases, teachers’ SAT and GRE scores. We 
convert the various test scores into Z scores in order to place them on a common metric, and 

99 

experiment with using various test’s Z- scores as our measure of teacher academic proficiency. 
We use the average of teachers’ Praxis I (if present on teacher record) and Praxis II Z scores 

9 9 

(henceforth referred to as “teacher Z-score”) as controls for teacher quality. 

Teacher records from NCDPI are then matched to information obtained from the 
Educational Testing Service (ETS), which maintains NBPTS certification information for 
NBPTS teacher applicants. The ETS teacher records include the year in which teachers applied, 
the NBPTS certification area to which they applied, and if the teachers were ultimately 
successful in the process. 

In linking the NBPTS records to state teacher records, it was necessary to decide in which 
year it is appropriate to classify a teacher as being NBPTS -certified, because the application and 
certification process generally happens over the course of two school years. Based on the 
NBPTS ^plication and certification timeline (shown in figure 1 of appendix A), we opted to 
classify teachers’ certification status as the school year in which they completed the NBPTS 
requirements rather than the school year in which the results are announced, because the bulk of 
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the work for becoming NBPTS-certified (completing the application) occurs in the school year 

9 S 

prior to the one in which certifications are announced. 

The student records maintained by NCDPI contain student background information such 
as student’s race/ethnicity, gender, learning disability, free or reduced- price lunch status 
(available from the state in school year 1998-99 only), English proficiency status, grade and 
year, and test results for grades 3 through 10. The tests are designed to measure subject 
objectives defined in the North Carolina Standard Course of Study, and are used by the NCDPTs 
Accountability Department as part of the “ABC” education reform program to determine 
performance and growth/gain goals and ratings for all schools in the state. All tests are vertically 
aligned, allowing us to determine individual student achievement growth in addition to school 
growth performance by subtracting the previous year’s end-of- grade test from the subsequent 
year’s end-of-grade test in that subject.^^ 

We opted to restrict our study to elementary students in the 3rd, 4th, and 5th grades 
because elementary- level students are most likely to have only one teacher per grade, thus 
enabling us to link students’ records to their teachers. Our linkage of students and teachers was 
very successful, yielding pre- and post- test scores for a large number of students. In table B.l 
in appendix B, we report the number of student and teacher observations in each year, the 
number of these records that we vere able to match together and over time, and the number for 
which we have both a valid end-of- year test score and a pre-test score (either the beginning of 

9 8 

the year in the case of the 3rd grade, or the end of the previous year for the 4th and 5th grades). 
Of the NBCTs in our teacher observations, almost all of them have a NBPTS Generalist 
Certificate. 
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Overall, we were able to match 771,537 of the 889,655 student observations with their 



teachers (for three grades from the 1996-97 school year to the 1998-99 school year), which is 
about an 80 percent match rate. Of these, we matched 609,160 student observations with 32,399 
teacher observations that included valid scores for the reading pre- and end-of-year test, and 
611,517 student observations with 32,448 teacher observations that included this same 
information for math. Appendix table B.2 reports the number of teachers in each year who fall 
into different NBPTS certification categories: future, current, and past applicant, and future, 
current, new, and past NBCT. Because the program is growing rapidly and we have an extra year 
of information about teachers (the 1999-00 school year), in every year there are many more 
future applicants and future NBCTs in our sample than past applicants or past NBCTs.^^ 

Table 1 presents student means by NBPTS teacher certification status for selected 
student and teacher variables. Roughly 9,000 unique students in our sample of 390,449 unique 
students have a teacher who taught them while she was going through the NBPTS assessment 
process. Approximately 6,000 students in our sample have a teacher who was successfully 
NBPTS -certified by the time that teacher taught them. Although students with NBCTs have, on 
average, higher end-of-year test scores in both math and reading, they also tend to have higher 
initial pre-test scores. Still, the growth in both reading (6.18 points) and math (10.21 points) 
performance for students who have NBCTs was slightly higher (the difference was statistically 
significant at the 1 percent level) than the growth for both those who have nonapplicant teachers 
(5.69 and 9.75 for reading and math, respectively) and those who have teachers who were 
unsuccessful applicants (5.83 and 9.14 for reading and math, respectively, and again the 
difference is statistically significant at the 1 percent level). These differences, nonetheless, are 
relatively small; the largest differential is in math between certified and noncertified applicants. 
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at just over a point on the exam or roughly 14 percent of a standard deviation in the growth in 
math scores. 

Some of these differences in test scores may be explained by factors other than the 
certification status of teachers. For example, NBCTs tend to be teaching in more affluent, well- 
educated school districts, and they are teaching in schools that have been judged by the state to 
be high-performing and that have fewer disadvantaged students. Furthermore, NBCTs 
themselves differ from non- NBCTs in that they are likely to have performed far better on any of 
the teacher licensure exams. In the next section, we explore whether any of these factors explain 
the differential in students’ average gain scores between NBCTs and non- NBCTs. 

IV. Results 

Prior to focusing on the NBPTS variables, it is worth discussing some of the other individual 

O 1 

student and school findings. On both reading and math tests, students who are black, female, 
participants in the free and reduced-price lunch program, and/or have learning disabilities do 
worse than students who are white, male, nonparticipants in the free/reduced- price lunch 
program, and/or do not have learning disabilities. Variables identifying years of teaching 
experience and having a “full” teaching license from the state (as opposed to a provisional or 
temporary license, or one that only meets the state’s initial teaching license requirements) are 
generally positive and significant. The signs and statistical significance levels for many of the 
other schooling variables, however, are sensitive to model specification and often counter- 
intuitive, which is consistent with much of the educational productivity literature. For example, 
in some model specifications we find that a teacher having an advanced degree is detrimental to 
student achievement and that students benefit from being in either larger dasses or larger 
schools. 
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Table 2 shows coefficient estimates for key teacher and NBPTS variables in reading and 
math achievement models. Columns 1 through 6 show the results for various specifications of 
the growth in the reading achievement model, and columns 7 through 12 show various 
specifications for the growth in the math achievement model. Prior to discussing these results, it 
is worth noting that the results discussed below are quite insensitive to the elimination of 
students with learning disabilities or who are limited English dependent. Further, the estimation 
of models where the post- test score is regressed on a lagged test score along with the other 
specified controls generates NBPTS findings that are not materially different from those that are 
reported. 

A. NBPTS Certification as a Signal of Effective Teaching 

We begin by assessing how NBCTs compare to non-NBCTs, which is the comparison of interest 
for policymakers who may wish to use the NBPTS credential as a signal of teacher quality. 
Recall that we can compare NBCTs both prior to their receiving certification and after they have 
been identified by NBPTS as having mastered the standards for “what accomplished teachers 
should know and be able to do.” Thus, in the first specification of the reading (column 1 of table 
2) and math (column 7 of table 2) models we include two NBPTS variables: whether a teacher in 
our sample is an NBCT (“current NBCT”), and whether a teacher who is not currently certified 
becomes an NBCT at some point in the future, up through the 1999-2000 school year (“future 

n c 

NBCT”). The excluded comparison group in this specification (non-NBCTs) includes those 
teachers who are either non- applicants or who apply to the program but fail to achieve 
certification. 

The magnitudes of the future NBCT coefficients suggest that student gains produced by 
NBCTs exceed those of noncertified applicants by about 4 percent of a standard deviation in 
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reading and 5 percent of a standard deviation in math (based on a standard deviation of 9.94 on 
the end-of-year reading tests and 12.34 on the end-of-year math tests). These effects sizes are 
of the same order of magnitude as those found for math teachers having a bachelor’s degree in 
their subject area (Goldhaber and Brewer 1997). The findings for current NBCTs are smaller but 
still positive, and in the case of the reading model, statistically significant (we discuss possible 
reasons for differences in the estimated coefficients of future and current NBCTs below). 

Our finding that NBCTs appear more effective than non-NBCTs is perhaps not 
surprising, given the aforementioned research linking measures of teachers’ academic 
proficiency to students’ achievement, and previous research showing a strong correlation 
between teachers’ performance on licensure tests and both the likelihood of application to 
NBPTS and eventual certification of teacher applicants (Coldhaber et al. 2004). It does, 
however, raise the question of whether NBPTS certification conveys information about teacher 
quality above and beyond that which is learned from teachers’ licensure test performance. This is 
an important public policy question, since states and localities might simply use licensure 
performance in place of NBPTS certification were it to provide as much information about 
teacher quality. This would, of course, allow for considerable savings: the cost of the NBPTS 
assessment alone is $2,300, and many states and localities also provide salary supplements for 
their certified teachers. 

To address this issue, we report specifications of the reading (column 2 of table 2) and 
math (column 8 of table 2) achievement models that include a control for teachers’ licensure 
performance (their Z- score). Surprisingly, in both models the magnitude of the coefficient 
estimates on the NBPTS variables diminish only slightly with the addition of this teacher- quality 
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control. This suggests that NBPTS certification does in fact convey information about teacher 
quality above and beyond what can be learned from performance on teacher licensure tests alone. 

One of the surprising results from these models is that future NBCTs appear to be far 
more effective prior to receiving their certification than after they have received it (based on the 
difference in magnitudes of the coefficients of future and curreit NBCT). A finding that the 
coefficient on current NBCT is not larger than future NBCT would suggest that NBPTS 
certification does not add to teachers’ human capital (an issue we explore in greater depth 
below), but our findings actually suggest that teachers destined for certification are more 
effective before they are recognized by NBPTS. One possibility for this seemingly strange result 
is that the time intensity of the NBPTS assessment process makes NBCTs less effective in the 
year in which they receive certification, because they are allocating a significant amount of time 
to completing the assessment that would otherwise be allocated toward teaching. 

We test the hypothesis that teacher effectiveness may be influenced by the time taken to 
complete the NBPTS assessment by estimating specifications of the model that include four 
NBPTS variables: future NBCT (defined above), whether a teacher is an applicant to NBPTS in 
year t (“current applicant”), whether a teacher is certified in year t (“new NBCT”), and whether a 
teacher was certified in a year prior to year t (“past NBCT”). The omitted comparison group in 
this model specification is non-applicant teachers. This model specification is reported in column 
3 of table 2 for reading and column 9 of table 2 for math. 

In addition to allowing us to test the time- allocation hypothesis (an issue explored in 
greater detail in the next subsection), this specification has the added benefit of providing a 
measure of whether NBPTS is identifying the more- effective teachers among those that actually 
apply to the program. Recall that NBPTS is making judgments only about those teachers who 
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have applied for certification, so a comparison between current NBCTs and noncertified teachers 
ignores the possibility that the NBPTS ^plicant pool might be very different from the teacher 
workforce as a whole. Thus, to judge the effectiveness of the NBPTS assessment process, we 
wish to compare NBCTs to unsuccessful NBPTS applicants, a comparison that is identified in 
this model specification by the coefficient of new NBCT. 

The positive significant coefficient for new NBCT, in both reading and math models, 
indicates that teachers who are successful in their attempt to attain certification are more 
effective than those who are unsuccessful applicants, providing evidence that NBPTS is in fact 
identifying the more effective teachers of those they actually evaluate. The magnitude of the 
coefficients suggests that students of NBCTs would be expected to achieve growth exceeding 
that of students of unsuccessful applicants by about 5 percent of a standard deviation in reading 
and 9 percent of a standard deviation in math. 

The primary reason for the differential between certified and uncertified teacher 
applicants is that teachers who apply to the program but are unsuccessful in their attempt at 
certification are actually less effective than non- applicant teachers (this effect is identified by the 
coefficient on current applicant). The total effect on students of having an NBCT in the year in 
which 4iey apply to the program — the sum of the coefficients of current applicant and new 
NBCT — is not statistically different than zero, implying that NBCTs are no more or less 
effective than non-NBCTs when they are going through the NBPTS assessment process. These 
findings provide some evidence that the time required to complete the NBPTS assessment does 
have at least a short-term negative impact on teacher effectiveness. 

We might also expect that teachers who have achieved NBPTS certification would be 
more effective than non- applicants in the years after completing the process (as they were found 
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to be pre- assessment); a measure of this is the eoeffieient on past NBCT. However, neither our 
reading nor math results support this hypothesis: the magnitude of the past NBCT eoeffieient is 
smaller (and not signifieant) than the future NBCT eoeffieient in the reading model, and in the 

O Q 

math model it is aetually negative (but not signifieant). While we interpret these findings with 
eaution beeause our data set has very few teaehers who fall into the past NBCT eategory, the 
seemingly strange result that NBCTs are less effeetive after they reeeive eertifieation than before 
merits further investigation. 

There are at least two possible explanations for these anomalous findings that imply a 
bias in the estimates of the NBPTS variables. One is that teaehers may be eneouraged by 
prineipals or other distriet offieials to apply to NBPTS based on temporary upward blips in their 
performanee. If this tends to be the ease, then the findings may simply represent a phenomenon 
akin to a reverse “Ashenfelter dip” (Ashenfelter and Card 1985) where the future NBCT variable 
is biased upward and the smaller eoeffieient on past NBCT simply refleets teaehers reverting to 
their typieal level of performanee. A seeond explanation is that NBCTs tend to be assigned to 
different types of students. If, for instanee, they are systematieally assigned to higher- aehieving 
students (those with higher pre-test seores) and there is mean reversion in student test 
performanee, then the estimated eoeffieient of past NBCT would have a downward bias. We 
explore these possibilities in the following subseetions of the paper. 

B. Specification Checks: Does the NBPTS Assessment Add to Teacher Human Capital? 
One way to measure whether going through the NBPTS assessment proeess makes a teaeher 
more effeetive is to eompare the eoeffieients of past and future NBCT. As we diseussed above 
(in referenee to eolumns 3 and 9 of table 2), the results of this eomparison do not support this 
idea, sinee NBCTs appear to be more effeetive before they are certified than after. Models that 
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include teacher fixed-effects tend to confirm these findings. In a teacher fixed-effects math 
model the estimated coefficient of past NBCT (-.74) is statistically significant and negative, 
suggesting that NBCTs are not more effective teaching math than they were prior to completing 
the certification process (none of the coefficients were statistically significant in a teacher fixed- 
effects reading model). Again, these results should be interpreted very cautiously, since the 
impact of teachers’ NBPTS status is identified by variation over time in teachers’ NBPTS status 
and our three- year panel, of course, contains little variation. 

We further explore the question of whether the NBPTS process itself adds to a teacher’s 
human capital by estimating models that test whether any applicants — either successful or 
unsuccessful — benefit from going through the assessment process. Specifically, we estimate a 
model specification (reported in column 4 of table 2 for reading, and column 10 of table 2 for 
math) that includes three NBPTS application variables: future applicant, current applicant, and 
past applicant (non- applicants are the excluded comparison group). As was the case with 
certification, we might expect that if teachers accumulate human capital as a consequence of the 
assessment process they would be more effective post- than pre- assessment, whether they are 
successful or not in attaining certification. And, as we discussed above, it would not be 
surprising to find applicants to be less effective than non- applicants because of the time they are 
allocating to complete the NBPTS assessment. 

The pattern of results provides strong support for the hypothesis that the time required to 
complete the NBPTS assessment negatively impacts teacher effectiveness. In both math and 
reading, teacher applicants are significantly less effective in the year of application than they are 
in either the pre- or post- application year. The test of human capital effects among applicants 
also provides no evidence that completing the NBPTS assessment increases teacher 
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effectiveness. The coefficients on past applicant are not greater in magnitude than the 
coefficients on future applicant in either the reading or math models, but again this is based on a 
relatively small sample of past applicants. 

As discussed in the previous subsection, there are at least two potential sources of bias in 
our estimates of the NBPTS variables that could explain why we do not find stronger human- 
capital effects associated with the NBPTS process. One is that teachers might be encouraged by 
principals or other district officials to apply to NBPTS based on a temporary upward blip in their 
performance, and thus their post- certification performance reflects a return to their baseline. To 
test for this, we estimated a model that included separate indicator variables for each of the years 
prior to application to determine whether the year immediately prior to application looks to be 
significantly different from the pre- application trend in teacher effectiveness. While teachers do 
appear to be more effective in the year prior to application than they are during or post- 
application, there is only limited evidence that they are more effective in the year immediately 
prior to application. In reading and math, teachers appear to be slightly more effective in the year 
prior to application than they were two years prior to application (the difference in magnitude 
between the coefficients on one -year prior to application and two -years prior to application is 
significant at the 10 percent confidence level in reading and at the 5 percent level in math), but 
there was no significant difference found between the year prior to application and three years 
prior to application. Thus, it does not appear that the year prior to application represents an 
unusual upward deviation from the long-term trend in teacher effectiveness."^^ 

We might also imagine that differences in teacher performance before and after 
completing the NBPTS assessment process simply reflect differences in the effectiveness of 
various teacher cohorts. For instance, all “past applicants” are teachers who went through the 
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NBPTS assessment process in 1998-99 or an earlier year, while all “future applicants” are 
teachers who went through the NBPTS assessment process in 1997-98 or a later year. We 
attempt to distinguish between cohort and human- capital effects by estimating models that 
interact the application and year variables to determine whether applicants to the program 
appeared to be more effective teachers in some years than others. While there are some 
statistically significant interaction terms, these models do not appear to show any systematic 
relationship between the year of application and the measures of teacher effectiveness. 

A final potential source of bias is nonrandom teacher assignment, and specifically the 
possibility that NBPTS status affects the assignment of teachers. We explore this possibility in 
the models presented below. 

C. School and Student Fixed-Effects Model Specifications 

A significant amount of empirical evidence shows that teachers are not randomly distributed 
across students. Non white, poor, and low-performing students are more likely to be taught by 
less-qualified teachers, as measured by experience and degree levels, licensure status, licensure 
exam performance, and college selectivity (Lankford et al. 2002). This sorting pattern occurs 
both within and between districts, and the movement of experienced teachers between schools 
and districts tends to worsen inequities because more highly qualified teachers are found more 
likely to leave poor urban schools to teach in higher- performing, more affluent schools. Research 
by Levinson (1988) and Hanushek et al (2004) finds that students’ socioeconomic status and 
achievement play an important role in explaining the schools teachers choose as employers when 
they move from one school or district to another, and Goldhaber et al. (forthcoming) and 
Clotfelter et al. (2003) suggest that these nonrandom sorting patterns may be even more 
pronounced for NBCTs. 
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If teachers and teacher quality are nonrandomly distributed across students and student 
characteristics, as the evidence strongly suggests, and statistical models do not fully account for 
the student characteristics affecting achievement, then the estimated effects of observed teacher 
characteristics are likely biased. In fact, evidence suggests that the estimated impact of teacher 
credentials tends to be overstated due to nonrandom student and teacher assignment (Clotfelter et 
al. 2003). 

To take account of the nonrandom distribution of teachers across schools, we estimate 
specifications of the reading and math achievement models that include school fixed effects. The 
estimated teacher- variable coefficients in these models are identified based on within- school 
variation in teacher characteristics. Column 5 of table 2 shows the results of these models for 
reading growth, and Column 1 1 of table 2 shows the results for math growth. The inclusion of 
these school effects makes little difference in the estimates of NBCT effects. In both reading and 
math, we still find that teachers who will eventually be certified (future NBCT) are more 
effective prior to certification, and certified teachers are more effective than noncertified 
applicants (the coefficient of new NBCT) but no more effective than non- applicants (the sum of 
current applicant and new NBCT). There is no case where the magnitude of an estimated 
coefficient is statistically different from the base models, suggesting that most of the findings are 
not influenced by a nonrandom distribution of NBCTs across schools. 

These models account for nonrandom sorting of teachers across schools, but they do not 
account for the possibility that teachers may be nonrandomly sorted across students within 
schools. One could easily imagine this would occur due to seniority-based assignments, or to the 
pressures from parents to assign their students to particular teachers. We account for this within- 
school sorting by estimating specifications of our models that include student fixed effects. In 
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these models, the impacts of teacher characteristics are identified by variation over time in the 
characteristics of the teachers to which students are assigned. Columns 6 and 12 of table 2 
present the student fixed-effects specifications for reading and math, respectively."^^ The results 
of these models continue to show that NBCTs are more effective before they are recognized by 
NBPTS (based on the coefficient on future NBCT), however, we do find some notable 
differences in the estimated effects of newly and previously certified NBCTs. Specifically, in 
reading, newly certified teachers do not appear to be more effective than noncertified applicants 
(based on the coefficient on new NBCT), and previously certified NBCTs are no more effective 
than non- applicants. In math, we now find that previously certified NBCTs are actually less 
effective than are non- applicants. While these results must be interpreted with some caution 
given that they are based on a three- year panel (so there is relatively little time- series variation 
by which to identify these effects) and there are relatively few previously certified NBCTs in the 
data, they are nevertheless puzzling. One possible explanation for the findings on new and past 
NBCTs is mean- reversion of scores among high- achieving students. If mean- reversion exists and 
NBCTs are systematically assigned to students with high pre-test scores, as appears to be the 
case (Clotfelter et al. 2003; Goldhaber et al. forthcoming), then mean- reversion would imply a 
negative bias in the estimates of the effects of NBCTs. 

D. Results by Student Subgroup and Grade Level 

There are several reasons why the effects of new NBCTs and future NBCTs on students might 
vary by student subgroup or grade level. Empirical evidence dating from the “Coleman Report” 
(Coleman et al. 1966) tends to find that teacher quality has a larger impact on lower- achieving 
students than on those who are higher- achieving, and this finding has recently been confirmed by 
empirical work drawing on an experiment where students are randomly assigned to teachers 
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(Nye et al. 2004). Furthermore, NBPTS is thought to value particular constructivist approaches 
to teaching (Wilcox 1999; Ballou 2003) that may be more or less effective when employed with 
different types of students or with students of varying ages or academic achievement levels. 
Whether the impact of NBCTs varies by student subgroup or grade level is also an important 
public policy concern: educational administrators need this information in order to allocate 
NBCTs effectively across students and grades. For all these reasons, we present results that are 
broken out by student subgroup (free and reduced-price lunch status and race) (table 3) and 
grade level (table 4 ).^^ 

Our findings for various student subgroups are consistent with previous findings that 
teacher quality has a larger impact on poor students than on higher- income students (Coleman 
1990). The magnitude of the effect of having a new NBCT or a past NBCT is significantly larger 
in reading for students who are receiving free or reduced-price lunch than those who are not 
(comparing columns 1 and 3 of table 3), and is significantly larger for having a new NBCT or a 
future NBCT in math for students who are receiving free or reduced-price lunch than those who 
are not (comparing columns 2 and 4 of table 3). 

There are also some notable differences in findings for students of different races or 
ethnicities. Future NBCT is positive and significant across all student race groups, but the effects 
are largest for students in the “other” category, where the point estimates for the reading and 
math models (.83 in reading and .96 in math) are statistically different from the point estimates 
for white students (.34 in reading and .65 in math) and black students (.31 in reading and .55 in 
math) (see table 3)."^^ Though not reported here, we also estimated student and school fixed- 
effects specifications of the above models. The pattern of results (the direction of the estimated 
effects) for white students is generally similar, though the levels of statistical significance 
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change, whereas there are no consistent results for the various categories of minority students, 
which is not surprising given the small numbers of minority students who have NBCTs. 

When examining the grade- level models, the overall patterns of results tend to be 
consistent with our findings above: we see large positive effects for future NBCTs, some positive 
NBPTS identification effects but little or no difference between NBCTs and non- applicants in 
the year of application, and divergent results in math and reading for past NBCTs. We also 
observe important differences in the estimated effects by grade level. In general, the largest 
significant positive NBPTS effects are found in the M grade. For example, while the future 
NBCT coefficient is positive and statistically significant for all grades and both subjects, the 
magnitude of this coefficient is significantly hrger in the 3rd grade than either the 4h or 5th 
grades (comparing across columns in table 4). The new NBCT coefficient is significant and 
positive for both reading and math in the 3rd grade, but outside of the 3rd grade it is only 

AQ 

positive and significant for 4th grade math. The differential impacts of new NBCTs and future 
NBCTs by grade level have important policy implications: these results at least suggest that 
greater benefits are provided to students if NBCTs are assigned to teach the earlier elementary 
grades. 



V. Public Policy Implications and Conclusions 

The significant interest, investment, and growth in NBPTS certification represents an important 
effort to try to professionalize teaching, bring effective educational practices to the classroom, 
and ultimately enhance student learning. But, until now there has been little quantitative research 
assessing whether NBPTS certification is actually associated with student outcomes. In this 
paper we consider NBPTS certification both as an indicator of and as a catalyst for teacher 
effectiveness. Our findings appear to confirm that there is value to the NBPTS assessment 
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process in distinguishing between more- and less- effective teachers: teachers who are certified 
by NBPTS tend to be more effective than unsuccessful applicants to the program. These results 
are robust to a number of different model specifications, including those that account for the 
potential nonrandom matching of students to schools or classrooms. While we consistently find 
that teachers who will eventually be NBPTS -certified are more effective, there are mixed 
findings about their effectiveness post-certification — making judgments about the “signal” 
hypothesis less certain. As for the hypothesis that NBPTS certification acts as a catalyst for 
effective teaching, by building teachers’ human capital, we find no evidence to support the 
notion that completing the NBPTS assessment process increases teacher effectiveness. 

Our findings that NBCTs appear to be no more effective (and in some cases less 
effective) post- certification than they were pre- certification are rather puzzling. As we discussed 
above, these findings may simply be an artifact of the relatively small group of teachers in our 
sample who were teaching (post-certification) having already completed the NBPTS process. 
They may also reflect one or more of the potential sources of bias we discussed (though the 
checks we were able to perform with the available data appear to rule these out). One possible 
explanation for why NBCTs appear to be less effective after becoming certified is that teachers 
who are certified may, post- certification, devote a greater share of their time and effort to 
endeavors outside of their own classes. Although an investigation of this issue is beyond the 
scope of this study, the notion that NBCTs might be taking on new or different responsibilities is 
consistent with the National Board’s original conception of the roles that NBCTs might play in 
schools — for instance, serving as mentor teachers or curriculum specialists 
(http://www.nbpts.org/about/prop5). It is also consistent with findings from surveys of NBCTs, 
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which suggest that they do take on more schoolwide roles upon becoming certified 
(http ://w w w .nbpts . org/pdf/leadership_survey .pdf) . 

While the main conclusion that people may take from this paper might be, “National 
Board successfully identifies effective teachers,” policymakers would do well to look more 
closely. Ultimately, whether or not the investment of public dollars in NBPTS makes sense 
depends on more nuanced findings that suggest its benefits differ by grade level and student type. 
We find, for example, that schools with NBCTs receive substantially more educational benefits 
from having their NBCTs teach low- income students in earlier grades. It may also depend on 
the effects of applying to the program since we find that unsuccessful current applicants are 
actually less-effective teachers in the year in which they apply to NBPTS. Schools with many 
unsuccessful applicants, or those with successful applicants who leave after obtaining 
certification, may actually be worse off for having had their teachers apply to the program (recall 
that NBCTs are no more, or less, effective than non- applicants in the year of application, and 
unsuccessful applicants are actually less effective than non- applicants while they are completing 
the assessment process). Considering this, the total impact of the NBPTS program on schools 
will depend on the assignment and retention of NBCTs as well as the number of successful and 
unsuccessful applicants in a given school. These more subtle findings suggest that understanding 
the impact NBPTS has on students requires not just an assessment of its worth as an indicator of 
quality or a catalyst for building human capital. It also requires an understanding of how NBPTS 
affects teachers’ career paths: Who do NBCTs teach? How long do they teach? Do the roles of 
NBCTs extend beyond the classrooms in which they are assigned to teach? All of these are 
important questions for further empirical study. 
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Table 1. Selected Sample Statistics “ 

(Standard deviations in parenthesis) 





Non-applicants 


Applicant, Not 
NBPTS Certified 


Applicant, NBPTS 
Certified 




Reading 


Math 


Reading 


Math 


Reading 


Math 


Student Test Scores 


Post-test 


149.47 

(9.94) 


150.39 

(12.34) 


149.47 

(9.72) 


149.80 

(12.93) 


151.52 

(9.72) 


152.38 

(12.29) 


Pre-test 


143.78 


140.64 


143.65 


140.67 


145.34 


142.17 


(10.19) 


(12.80) 


(10.28) 


(13.26) 


(10.35) 


(13.01) 


Growth in test score in 


5.69 


9.75 


5.83 


9.14 


6.18 


10.21 


one year 


(6.13) 


(6.92) 


(6.27) 


(6.64) 


(6.37) 


(7.00) 


Teacher Characteristics 


Black 


0.14 


0.14 


0.24 


0.24 


0.07 


0.07 


(.34) 


(.34) 


(.43) 


(.43) 


(.25) 


(.25) 


White 


0.85 


0.85 


0.75 


0.75 


0.93 


0.92 


(.35) 


(.35) 


(.41) 


(.43) 


(.26) 


(.26) 


Female 


0.94 


0.94 


0.98 


0.98 


0.98 


0.98 


(.24) 


(.24) 


(.15) 


(.15) 


(.13) 


(.13) 


Years of teaching 


13.18 


13.18 


12.54 


12.52 


12.55 


12.56 


experience 


(9.86) 


(9.86) 


(7.81) 


(7.79) 


(7.88) 


(7.89) 


Teacher Z«core 


-0.03 

(0.87) 


-0.03 

(0.87) 


-0.16 

(0.85) 


-0.16 

(0.85) 


0.37 

(0.87) 


0.36 

(0.86) 


School Characteristics 


School of “excellence”*’ 


0.02 

(.13) 


0.02 

(.13) 


0.02 

(.14) 


0.02 

(.14) 


0.07 

(.25) 


0.07 

(.25) 


School of “distinction” ‘ 


0.18 

(.38) 


0.18 

(.38) 


0.20 

(.40) 


0.20 

(.40) 


0.31 

(.46) 


0.31 

(.46) 


Proportion of free/ 
reduced-price lunch 
students 


0.36 

(0.19) 


0.36 

(0.19) 


0.42 

(.22) 


0.42 

(0.22) 


0.31 

(0.18) 


0.31 

(0.18) 


Proportion of minority 
students 








Min 




0.32 
( 0.22) 


District/Community Characteristics 


Percent in community 


16.92 


16.92 


15.25 


15.23 


19.52 


19.51 


with at least a BA 


(11.19) 


(11.18) 


(10.76) 


(10.76) 


(12.61) 


(12.6) 


Average household 


33.11 


33.11 


31.87 


31.84 


34.65 


34.64 


income (in thousands) 


(6.33) 


(6.34) 


(6.59) 


(6.59) 


(6.53) 


(6.53) 


Median housing value 


66.05 


66.05 


64.23 


64.18 


69.62 


69.58 


(in thousands) 


(16.52) 


(16.52) 


(16.59) 


(16.60) 


(17.75) 


(17.75) 


Sample size 


600,261 


602,577 


4,602 


4,622 


4,297 


4,318 



“ Student observations were divided into one of three categories: teacher was presently not applying to NBPTS (“non-applicant”); teacher was an 
unsuccessful current applicant that year (“Applicant, Not NBPTS Certified”); teacher was a successful current applicant that year (“Applicant, 
NBPTS Certified”). 

Schools of excellence have 90-100% of their students performing at or above grade-level. 

‘ Schools of distinction have 80-89% of their students performing at or above grade level. 
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Table 2. Selected Coefficients for Growth in Test-Score Models 



(Standard errors in parenthesis) 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 






Reading Achievement Growth 






Math Achievement Growth 




Future 

applicant 








1 ^*** 

(. 04 ) 












21 *** 

(. 04 ) 






Current 

applicant 






- 34 *** 

(. 09 ) 


-.11 

(. 07 ) 


_ 37 *** 

(. 09 ) 


_ 32*** 

(. 17 ) 






-1 01 *** 
(. 10 ) 


_ 39 *** 

(. 07 ) 


- 1 . 06 *** 

(. 10 ) 


- 1 . 65 *** 

(. 19 ) 


Past applicant 








.08 

(. 09 ) 












-. 19 * 

(. 10 ) 






Future NBCT 


. 36 *** 

(. 05 ) 


35 *** 

(. 05 ) 


3 g *** 

(. 05 ) 




34 *** 

(. 05 ) 


. 46 *** 

(. 09 ) 


62 *** 

(. 05 ) 


39 *** 

(. 05 ) 


^ 9 *** 

(. 05 ) 




63 *** 

(. 06 ) 


66 *** 

(. 11 ) 


Current NBCT 


18 ** 

(. 08 ) 


. 16 ** 

(. 08 ) 










.08 

(. 09 ) 


.04 

(. 09 ) 










New NBCT 






47 *** 

(. 13 ) 




43 *** 

(. 13 ) 


.09 

(. 25 ) 






1 10 *** 
(. 14 ) 




1 17 *** 

(. 14 ) 


1 59 *** 
(. 28 ) 


Past NBCT 






.22 

(. 14 ) 




. 27 * 

(. 15 ) 


.04 

(. 27 ) 






-.13 

(. 15 ) 




-.11 

(. 16 ) 


- 1 . 22 *** 

(. 30 ) 


Teaching exp: 
1-2 yrs (base - 0 
years) 


21 *** 

(. 04 ) 


21 *** 

(. 04 ) 


21 *** 

(. 04 ) 


21 *** 

(. 04 ) 


13 *** 

(. 04 ) 


34 *** 

(. 07 ) 


43 *** 

(. 04 ) 


43 *** 

(. 04 ) 


42 *** 

(. 04 ) 


42 *** 

(. 04 ) 


33 *** 

(. 04 ) 


41 *** 

(. 08 ) 


3-5 yrs 


26 *** 

(. 04 ) 


27 *** 

(. 04 ) 


27 *** 

(. 04 ) 


27 *** 

(. 04 ) 


24 *** 

(. 05 ) 


44 *** 

(. 08 ) 


. 50 *** 

(. 05 ) 


31 *** 

(. 05 ) 


32 *** 

(. 05 ) 


50 *** 

(. 05 ) 


45 *** 

(. 05 ) 


54 *** 

(. 09 ) 


6-12 yrs 


31 *** 

(. 04 ) 


32 *** 

(. 04 ) 


32 *** 

(. 04 ) 


31 *** 

(. 04 ) 


31 *** 

(. 05 ) 


34 *** 

(. 08 ) 


53 *** 

(. 05 ) 


55 *** 

(. 05 ) 


56 *** 

(. 05 ) 


34 *** 

(. 05 ) 


55 *** 

(. 05 ) 


7 ^*** 

(. 09 ) 


13+ yrs 


^ 2 *** 

(. 05 ) 


43 *** 

(. 05 ) 


43 *** 

(. 05 ) 


42 *** 

(. 05 ) 


43 *** 

(. 05 ) 


73 *** 

(. 09 ) 


63 *** 

(. 05 ) 


66 *** 

(. 05 ) 


66 *** 

(. 05 ) 


63 *** 

(. 05 ) 


66 *** 

(. 05 ) 


33 *** 

(. 10 ) 


Teacher 

degree: master’s 
(base=BA) 


-.01 

(. 02 ) 


-.02 

(. 02 ) 


-.02 

(. 02 ) 


-.01 

(. 02 ) 


-.02 

(. 02 ) 


-.01 

(. 04 ) 


Q 2 *** 

(. 02 ) 


05 *** 

(. 02 ) 


06 *** 

(. 02 ) 


09 *** 

(. 02 ) 


. 05 ** 

(. 02 ) 


10 ** 

(. 04 ) 


Doctorate degree 


-.04 

(. 06 ) 


-.05 

(. 06 ) 


-.04 

(. 06 ) 


-.03 

(. 06 ) 


-.04 

(. 07 ) 


- 25 ** 

(. 12 ) 


-.03 

(. 07 ) 


-.05 

(. 07 ) 


-.04 

(. 07 ) 


<.01 

(. 07 ) 


-. 15 ** 

(. 07 ) 


_ 40 *** 

(. 13 ) 


Teacher license: 
full (base=other) 


22 *** 

(. 03 ) 


21 *** 

(. 03 ) 


22 *** 

(. 04 ) 


22 *** 

(. 03 ) 


2 Q *** 

(. 04 ) 


.07 

(. 06 ) 


23 *** 

(. 04 ) 


23 *** 

(. 04 ) 


23 *** 

(. 04 ) 


30 *** 

(. 04 ) 


23 *** 

(. 04 ) 


25 *** 

(. 07 ) 


Teacher Z- score 


No 


Yes 


Yes 


Yes 


Yes 


Yes 


No 


Yes 


Yes 


Yes 


Yes 


Yes 


Fixed-effect 


No 


No 


No 


No 


School 


Student 


No 


No 


No 


No 


School 


Student 




0.06 


0.06 


0.06 


0.06 


0.07 


0.57 


0.10 


0.10 


0.10 


0.10 


0.11 


0.57 


Sample size 






609,160 










611,517 






***, **, *: Significant at 1%, 5%, and 10% confidence level, respectively. 

Notes: These models also include controls for student’s grade, race/ethnicity, gender, free/reduced-price lunch status (free/reduced-price lunch information was available in 
1999 only), limited English proficiency status, learning disability status; teacher’s age, race/ethnicity, gender, years of teaching experience, license type, license basis, degree 
level; total students at school, fraction of minority students at school, student -teacher ratio at school, fraction of free/reduced-price lunch students at school; total students in 
district, current per pupil expenditure, percent of education expenditure spent on instruction, urbanicity, starting salary for teachers with a B.A. and no experience in district; 
community’s median housing value, percent in community with at least a B.A.; and the year of the test. Mean value replacement was used for cases where values for the 
explanatory variables were missing, except in the case of free/reduced-price lunch status, where missing values were coded as “no lunch information.” 



31 




























Table 3. Selected Coefficients for Growth in Test-Score Models 



Broken Out by Student Subgroup 

(Standard errors in parentheses) 





Recipients of Free 
or Reduced-Price 
Lunch 


Nonrecipients of 
Free or Reduced- 
Price Lunch 


White 


Black 


Other 




1 


2 


3 


4 


5 


6 


7 


8 


9 


10 




Read 


Math 


Read 


Math 


Read 


Math 


Read 


Math 


Read 


Math 


Future NBCT 


. 55 *** 

(. 19 ) 


1 Q 9 *** 
(. 21 ) 


32 ** 

(. 13 ) 


55 *** 

(. 14 ) 


34 *** 

(. 06 ) 


65 *** 

(. 06 ) 


32 *** 

(. 10 ) 


55 *** 

(. 12 ) 


g 3 *** 

(. 24 ) 


96 *** 

(. 27 ) 


Current 

applicant 


-. 34 * 

(. 19 ) 


- 86 *** 
(. 20 ) 


-.20 

(. 17 ) 


_ ^ 9 *** 
(. 18 ) 


-. 21 * 

(. 11 ) 


_ 72 *** 
(. 12 ) 


_ 42 *** 
(. 16 ) 


-1 20 *** 
(. 18 ) 


-.51 

(. 37 ) 


- 2 . 35 *** 

(. 41 ) 


New NBCT 


(. 29 ) 


1 52 *** 

(. 31 ) 


.18 

(. 22 ) 


gQ *** 

(. 23 ) 


. 36 ** 

(. 15 ) 


g 9 *** 

(. 17 ) 


.32 

(. 25 ) 


73 *** 

(. 28 ) 


1 . 37 ** 

(. 56 ) 


3 . 10 *** 

(. 62 ) 


Past NBCT 


. 58 * 

(. 30 ) 


-.01 

(. 33 ) 


.10 

(. 20 ) 


.06 

(. 21 ) 


34 ** 

(. 17 ) 


-.02 

(. 18 ) 


-.08 

(. 29 ) 


-.24 

(. 33 ) 


-.28 

(. 61 ) 


- 1 . 59 ** 

(. 68 ) 


Teaching exp: 
1-2 yrs (base = 0 
years) 


(. 10 ) 


93 *** 

(. 11 ) 


.08 

(. 08 ) 


5 ]^*** 

(. 09 ) 


]^ 7 *** 

(. 05 ) 


4 Q *** 

(. 05 ) 


22 *** 

(. 07 ) 


4 Q *** 

(. 08 ) 


53 *** 

(. 16 ) 


g 9 *** 

(. 18 ) 


3-5 yrs 


62 *** 

(. 12 ) 


1 . 03 *** 

(. 13 ) 


.09 

(. 10 ) 


^9*** 

(. 11 ) 


27 *** 

(. 06 ) 


42 *** 

(. 06 ) 


32 *** 

(. 08 ) 


58 *** 

(. 09 ) 


67 *** 

(. 19 ) 


72 *** 

(. 21 ) 


6-12 yrs 


59*** 

(. 12 ) 


1 . 05 *** 

(. 13 ) 


.08 

(. 10 ) 


63 *** 

(. 11 ) 


22 *** 

(. 06 ) 


52 *** 

(. 06 ) 


46 *** 

(. 08 ) 


55 *** 

(. 09 ) 


53 *** 

(. 19 ) 


76 *** 

(. 21 ) 


13-1- yrs 


7 ^*** 

(. 13 ) 


]^ 4 *** 

(. 14 ) 


.17 

(. 10 ) 


56 *** 

(. 11 ) 


33 *** 

(. 06 ) 


60 *** 

(. 06 ) 


56 *** 

(. 08 ) 


77 *** 

(. 09 ) 


72 *** 

(. 19 ) 


68 *** 

(. 22 ) 


Teacher 

degree: master’s 
(base - BA) 


.01 

(. 05 ) 


.04 

(. 05 ) 


.02 

(. 04 ) 


.04 

(. 05 ) 


.02 

(. 02 ) 


Qg *** 

(. 02 ) 


-.05 

(. 04 ) 


-.01 

(. 04 ) 


_ 22 *** 
(. 08 ) 


.07 

(. 09 ) 


Doctorate degree 


-.06 

(. 19 ) 


-.03 

(. 21 ) 


-.01 

(. 14 ) 


-.02 

(. 15 ) 


-.07 

(. 07 ) 


-.08 

(. 08 ) 


.09 

(. 13 ) 


-.02 

(. 14 ) 


-.36 

(. 29 ) 


.35 

(. 33 ) 


Teacher license: 
full (base = other) 


.11 

(. 09 ) 


27*** 

(. 10 ) 


26 *** 

(. 08 ) 


. 14 * 

(. 08 ) 


2 g *** 

(. 04 ) 


32 *** 

(. 05 ) 


2 g *** 

(. 06 ) 


36 *** 

(. 07 ) 


.01 

(. 15 ) 


-.10 

(. 16 ) 




0.06 


0.03 


0.15 


0.14 


0.09 


0.15 


0.03 


0.02 


0.05 


0.08 


Sample size 


85,177 


85,970 


111,927 


112,133 


400,369 


401,434 


175,466 


176,502 


33,194 


33,447 


***, **, *: Significant at 1%, 5%, and 10% confidence level, respectively. 

Notes: The free/reduced-price lunch status models are run for records in 1999 only. These models also include controls for student’s grade, race/ethnicity, gender, 
limited English proficiency status, learning disability status; teacher’s age, race/ethnicity, gender, years of teaching experience, teacher Z-score, license type, 
license basis, degree level; total students at school, fraction of minority students at school, student -teacher ratio at school, fraction of free/reduced- price lunch 
students at school; total students in district, current per pupil expenditure, percent of education expenditure spent on instruction, urbanicity, starting salary for 
teachers with a B.A. and no experience in district; community’s median housing value, and percent in community with at least a B.A. Mean value replacement 
was used for cases where values for the explanatory variables were missing, except in the case of free/reduced-price lunch status, where missing values were 
coded as “no lunch information.” 

The race models also include controls for student’s grade, gender, free/reduced-price lunch status (free/reduced-price lunch information was available in 
1999 only), limited English proficiency status, learning disability status; teacher’s age, race/ethnicity, gender, years of teaching experience, teacher Z-score, 
license type, license basis, degree level; total students at school, fraction of minority students at school, student -teacher ratio at school, fraction of free/reduced- 
price lunch students at school; total students in district, current per pupil expenditure, percent of education expenditure spent on instruction, urbanicity, starting 
salary for teachers with B.A. and no experience in district; community’s median housing value, percent in community with at least a B.A.; and the year of the 
test. Mean value replacement was used for cases where values for the explanatory variables were missing, except in the case of free/reduced-price lunch status, 
where missing values were coded as “no lunch information.” 
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Table 4. Selected Coefficients for Growth in Test-Score Models 



Broken Out by Grade Level 

(Standard errors in parentheses) 





3rd Grade 


4th Grade 


5th Grade 




1 


2 


3 


4 


5 


6 




Read 


Math 


Read 


Math 


Read 


Math 




49 *** 


95 *** 


. 26 *** 


34 *** 


29 *** 


51 *** 


Future NBCT 


(. 09 ) 


(. 09 ) 


(. 08 ) 


(. 10 ) 


(. 08 ) 


(. 09 ) 


Current applicant 


-. 38 ** 


-1 07 *** 


-. 26 * 


-1 18 *** 


_ 44 *** 


-. 64 *** 


(. 16 ) 


(. 17 ) 


(. 16 ) 


(. 18 ) 


(. 13 ) 


(. 15 ) 




1 


1 72 *** 


-.10 


94 *** 


.11 


. 36 * 


New NBCT 


(. 23 ) 


(. 24 ) 


(. 22 ) 


(. 26 ) 


(. 19 ) 


(. 22 ) 




. 63 ** 


]^ 4 *** 


.27 


- 83 *** 


.03 


-. 45 ** 


Past NBCT 


(. 31 ) 


(. 32 ) 


(. 23 ) 


(. 27 ) 


(. 20 ) 


(. 22 ) 


Teaching exp: 


. 18 ** 


. 58 *** 


29 *** 


31 *** 


17 *** 


46 *** 


1-2 yrs (base = 0 years) 


(. 07 ) 


(. 08 ) 


(. 06 ) 


(. 07 ) 


(. 07 ) 


(. 07 ) 




. 22 ** 


. 60 *** 


. 26 *** 


51 *** 


. 26 *** 


4 g *** 


3-5 yrs 


(. 09 ) 


(. 09 ) 


(. 07 ) 


(. 08 ) 


(. 07 ) 


(. 08 ) 


6-12 yrs 




72 *** 


4 ]^ *** 


54 *** 


. 26 *** 


43 *** 


(. 09 ) 


(. 09 ) 


(. 07 ) 


(. 08 ) 


(. 07 ) 


(. 08 ) 


13+ yrs 




gQ *** 


53 *** 


70 *** 


35 *** 


57 *** 


(. 43 ) 


(. 09 ) 


(. 07 ) 


(. 09 ) 


(. 07 ) 


(. 08 ) 


Teacher degree: 


.03 


09 ** 


-.03 




-. 05 * 


-.01 


master’s (base = BA) 


(. 03 ) 


(. 04 ) 


(. 03 ) 




(. 03 ) 


(. 03 ) 


Doctorate degree 


.02 


-. 23 * 


-.14 


- 30 *** 


.02 


39 *** 


(. 13 ) 


(. 14 ) 


(. 09 ) 


(. 11 ) 


(. 09 ) 


(. 10 ) 


Teacher license: 




. 50 *** 


j^^*** 


28 *** 


.01 


Ig *** 


full (base = other) 


(. 06 ) 


(. 07 ) 


(. 06 ) 


(. 06 ) 


(. 05 ) 


(. 06 ) 




0.05 


0.06 


0.02 


0.02 


0.02 


0.01 


Sample size 


228,654 


229,623 


191,853 


192,606 


188,653 


189,288 



***, **, *: Significant at 1%, 5% and 10% confidence level, respectively. 

Notes' The grade- level models also include controls for student’s gender, free/reduced-price lunch status (ffee/reduced-price lunch information was 
available in 1999 only), limited English proficiency status, learning disability status; teacher’s age, race/ethnicity, gender, years of teaching experience, 
teacher Z-score, license type, license basis, degree level; total students at school, fraction of minority students at school, student-teacher ratio at school, 
fraction of free/reduced-price lunch students at school; total students in district, current per pupil expenditure, percent of education expenditure spent on 
instruction, urbanicity, starting salary for teachers with a B.A. and no experience in district; community’s median housing value, percent in community with 
at least a B.A.; and the year of the test. Mean value replacement was used for cases where values for the explanatory variables were missing, except in the 
case of free/reduced-price lunch status, where missing values were coded as “no lunch information.” 
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Figure 1. NBPTS Application Process Timeline 
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Appendix A 



Variable Definitions “ 



STUDENT VARIABLES 


DATA SOURCE 


VARIABLE DEFINITIONS 


Post-test 


NCDPI 


Student end-of-year test score 






Student test score from end of previous year, unless student was 


Pre-test 


NCDPI 


a third grader. Third graders take a beginning-of-the-year test as 
pre-test. 


Growth in test score in one year 


NCDPI 


Post-test score minus pre-test score 


Grade 
(4), (5) 


NCDPI 


Student grade as recorded on state record 


Race/Ethnicity 
(black), (other) 


NCDPI 


Student race as recorded on state record 


Gender 

(female) 


NCDPI 


Student gender as recorded on state record 


Year of record 
(1998), (1999) 


NCDPI 


Year of record 


Free/reduced- price lunch status 
(free or reduced participant), 
(no lunch information) 


NCDPI 


Student’s free and/or reduced-price lunch program eligibility 
(available from the state in 1999 only) 


Limited English 
proficiency status 


NCDPI 


State indicates that student is classified as an LEP student 


Learning 
disability status 


NCDPI 


State indicates that student has a learning disability in reading or 
math 


TEACHER VARIABLES 


DATA SOURCE 


VARIABLE DEFINITIONS 


Age 


NCDPI 


Teacher’s age (in years) at start of each school year 


Race/Ethnicity 
(black), (Hispanic), (Aslan) 


NCDPI 


Self-reported race/ethnicity of each teacher 


Gender 

(male) 


NCDPI 


Self-reported gender of each teacher 


Years of teaching 
experience 


NCDPI 


Years of teaching experience that the state of North Carolina 
credits teachers with (can be for non-teaching but subject-related 
experience) 


Teacher Z-score 


NCDPI 


Average Z-score from Z-scores of Praxis I and II, depending on 
what is available on teachers’ record 


License type 

(continuous license status) 


NCDPI 


Teacher is licensed on a permanent rather than temporary basis 


License basis 


NCDPI 


Teacher received license through an education program 


(North Carolina-based license) 


approved by, and located in, the state of North Carolina 


Master’s degree 


NCDPI 


Teacher’s highest degree is master’s degree 
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Ph.D. /other 
advanced degree 


NCDPI Teachers highest degree is Ph.D. or other advanced degree 


Future applicant 


NBPTS^* Teacher has not yet applied to NBPTS, but we know applies in a 

future year for which we have data 


Current applicant 


NBPTS^* Teacher applies to NBPTS in current year 


Past applicant 


NBPTS^* Teacher applied to NBPTS in a prior year 


Future NBCT 


NBPTS'* Teacher becomes a NBCT in future year 


Current NBCT 


NBPTS** Teacher is currently a NBCT 


New NBCT 


NBPTS** Teacher becomes a NBCT in present year 


Past NBCT 


NBPTS** Teacher had become an NBCT in a past year 


SCHOOL VARIABLES 


DATA SOURCE VARIABLE DEEINITION 


School of “excellence” 


Schools of excellence have 90- 100% of their students 
NCDPI web site performing at or above grade-level, determined by state 
standards. 


School of “distinction” 


NCDPI eb site S^^hools of distinction have 80-89% of their students performing 
at or above grade-level, determined by state standards. 


Total students 


Common Core of ^ , ,, , , , 

Total number of students enrolled at school 

Data 


Fraction of minority 
students 


Common Core of The fraction of minority students in school out of the total school 
Data population 


Student-teacher ratio 


Common Core of Total students in school divided by total number of full-time 
Data equivalent teachers 


Fraction of free/reduced-price 
lunch students 


^ ^ r The fraction of students eligible for free/reduced-price lunch 

Common Core of i i i ^ i t , * r , 

programs under the National School Lunch Act of the total 

school population 


DISTRICT/COMMUNITY 

VARIABLES 


DATA SOURCE VARIABLE DEFINITION 


Total students 


Common Core of Total number of students enrolled in PK-12 grades in district’s 
Data schools 


Current per pupil 
expenditures ($) 


Current expenditures are expenditures for the day-to-day 
operation of schools and school districts. They include 
Common Core of expenditures for instruction, support services, food services, and 
Data enterprise operations. They exclude expenditures for capital 

outlays and programs outside the regular preschool to grade 12 
scope. 


Percent education expenditure 
spent on instruction 


Common Core of ^ 

Instruction expenditures divided by total expenditures 


Urhanlcity 
(urban, suburban) 


Common Core of This is a conposite of local codes from the schools. Urban 

Data districts are those in large or mid-size central cities. Suburban 
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Starting salary with 
BA and no experience 


districts are found in the urban fringe of large or mid-size central 
cities. Rural districts are defined as those in large towns, small 
towns, or census-defined rural areas. 

NCDPI web site and 

phone calls to Starting salary for teachers with a bachelor’s degree and no 

individual school experience and in that district 
district offices 


Percent in community with 
at least a BA 


Common Core of Percent of residents with a bachelor’s degree or higher degree in 
Data community 


Average household income 
(In thousands) 


Common Core of ^ . r , , r i r r • , 

Average income for a household of four in the community 


Median housing value (in 
thousands) 


Median value of all housing units in district. Value is the 

1 ono n ^ respondent’s estimate of how much the property (house and lot, 

t^yt/ x,-.'ensus data i*ii ii *\ ii ii • 

mobile home and lot, or condominium unit) would sell for if it 

were for sale. 



^ For NBPTS variables, data are only available for teachers who applied for National Board Certification. 
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Appendix B 



Table B.l. Student and Teacher Record Matches with Pre- and Post-Tests 





1997 


1998 


1999 


Total 


Total student 
records 


286,574 


296,609 


306,469 


889,655 


Student and 
teacher merged 
records (STMs) 


246,049 


256,840 


268,648 


771,537 


STMs w/ 


Read 


Math 


Read 


Math 


Read 


Math 


Read 


Math 


end-of-grade 
(post) test scores 


236,462 


236,914 


245,542 


lA(>m 


257,085 


258,323 


739,089 


741,844 


STMs w/valid 


Read 


Math 


Read 


Math 


Read 


Math 


Read 


Math 


pre- and post-test 
scores 


202,443 


202,886 


190,839 


191,605 


215,878 


217,026 


609,160 


611,517 
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Table B.2. Number of Teachers in Each NBPTS Category by Year 



READING - Teacher Observations 




Fnture 

applicant 


Current 

applicant 


Past 

applicant 


Future 

NBCT 


Current 

NBCT 


New 

NBCT 


Past 

NBCT 


Total 


1997 


536 


27 


17 


335 


11 


11 


0 


937 


1998 


469 


146 


27 


280 


77 


65 


12 


1,076 


1999 


340 


285 


169 


190 


215 


140 


75 


1,414 


Total 


1,345 


458 


213 


805 


303 


216 


87 


3,427 




MATH - Teacher Observations 




Future 

applicant 


Current 

applicant 


Past 

applicant 


Future 

NBCT 


Current 

NBCT 


New 

NBCT 


Past 

NBCT 


Total 


1997 


538 


27 


17 


335 


11 


11 


0 


939 


1998 


471 


146 


27 


281 


77 


65 


12 


1,079 


1999 


340 


285 


169 


190 


215 


140 


75 


1,414 


Total 


1,349 


458 


213 


806 


303 


216 


87 


3,432 
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Table B.3. Numbers of NBCTs/Students with NBCTs in North Carolina across Years and 

Grades 



READING 


1997 


1998 


1999 


Total 


Grade 3 


4/80 


21 /415 


84/1,722 


109 / 2,217 


Grade 4 


3/62 


24 / 481 


65/1,226 


92/1,769 


Grade 5 


4/89 


32/609 


66/1,345 


102 / 2,043 


Total grade 3-5 
NBCTs 


11/231 


77 / 1,505 


215/4,293 


303 / 6,029 




MATH 


1997 


1998 


1999 


Total 


Grade 3 


4/81 


21 /420 


84/1,729 


109 / 2,230 


Grade 4 


3/62 


24 / 482 


65/1,225 


92/1,769 


Grade 5 


4/90 


32/610 


66/1,349 


102 / 2,049 


Total grade 3-5 
NBCTs 


11/233 


77/1,512 


215/4,303 


303 / 6,048 
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Endnotes 



^ Specifically, NBPTS was founded in 1987 with a threefold mission: (1) to establish high and 
rigorous standards for what accomplished teachers should know and be able to do; (2) to develop 
and operate a national voluntary system to assess and certify teachers who meet these standards; 
and (3) to advance related education reforms to capitalize on the expertise of National Board 
Certified Teachers (NBCTs) (http://www.nbpts.org). 

^ http://www.nbpts.org/pdf/quickfacts.pdf, accessed 11/22/05. 

Through September 2005. NBPTS states that a portion of these federal funds have provided 
subsidies to candidates to fund a portion of their respective candidate fees. 
(http://www.nbpts.org/pdf/quickfacts.pdf, accessed 11/22/05). 

Due to variations across years in the available data, this estimate was calculated in several 
steps. The application fee was originally $1,800 (through 1998), and increased to $2,300 
beginning in 1999. Since the actual number of NBPTS applicants prior to 1999 is not available 
due to problems with the data, we estimate the number of applicants from 1993-98 by 
multiplying the number of NBCTs (http://www.nbpts.org/nbct/nbctdir_byyear.cfm) in those 
years by 2 (according to ETS officials, the average first-time pass rate is roughly 50 percent). 
This gives us an estimated 9,612 applicants for the pre-99 years, which we multiply by $1,800, 
for a total estimated cost of $17.3 million for the first six years of the program. We then 
multiplied the actual number of applicants for 1999-2004 (91,316, according to an e-mail to the 
author from Anika Sandy- Hanson of NBPTS on 1 1/22/05) by $2,300 for a total actual cost of 
$210 million for 1999-2004. Adding these two amounts together gives us our total estimated 
application fees of $227.3 mi llion. 

^ As of September 2005, legislative and policy action creating incentives and recognition for 
National Board Certification has been enacted in all 50 states and in approximately 544 local 
school districts, including the District of Columbia; many of these offer at least one type of 
financial incentive (bonus or salary supplement) for teachers to become NBPTS -certified 
(http://www.nbpts.org/about/state.cfm, accessed 11/2/05). 

^ See http://www.cde.ca.gov/ta/sr/nb/faqs.asp for more information on this NBPTS incentive. 

^ For information on the NBPTS process as professional development, see 
http://www.nbpts.org/standards/nbcert.cfm. For a detailed description of the assessment see 
http://www.nbpts.org/standards/dev.cfm. 

^ See, for instance, Hanushek (1986, 1997) who suggests there is little relationship between 
teacher characteristics and student outcomes, and Hedges et al. (1994) or Card and Krueger 
(1996) who find more positive results. We discuss “teacher effectiveness” in this paper in terms 
of the teachers’ contributions towards student gains in achievement. 
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^ Education productivity studies typically measure the size of the relationship between various 
quantifiable education factors and student achievement. Goldhaber et al. (1999), for example, 
investigate the contributions of school, teacher, and class characteristics on student achievement. 
They find only about 3 percent of the contribution teachers make toward explaining student 
achievement is associated with teacher experience, degree level, and other readily observable 
characteristics. The remaining 97 percent is made up of teacher qualities or behaviors that could 
not be separately isolated and identified. 

The first-time pass rate was 48 percent during that time, according to ETS and NBPTS 
officials. It is important to distinguish between the first- time pass rate and individuals’ overall 
pass rate: individuals’ overall pass rate will be higher than the first-time pass rate, since 
individuals who are not initially successful in obtaining certification may re-apply to NBPTS in 
later years. 

This is the percentage of candidates who passed the Praxis II exam from 1994 to 1997, which 
is the most commonly used standardized test for teacher licensure (Latham et al. 1999). 

1 9 

We recognize that test performance is just one of many ways that NBCTs might influence 
student outcomes, and that NBPTS certification may have numerous impacts on students. Eor 
instance, NBCTs might affect the propensity of students to drop out of school or pursue interests 
in particular subjects. 

In addition to this specification we estimated lagged test- score models where the post- test 
score is regressed on a lagged test- score along with the other controls specified in equation 1, 
and we estimated models that included school fixed- effects, teacher fixed- effects, or student 
fixed- effects. 

We have information on this variable for 1999 only, when the state started collecting it. 

Eor information on any variables in our data set, see appendix A. 

http://www.nbpts.org/about/govt_nochild.cfm, accessed 11/2/05. 

1 ”7 

Unfortunately, as we discuss in greater detail below, we are somewhat limited in our ability to 
estimate the effects of teachers who either became NBPTS -certified or applied to the program 
but failed to gain certification in the years following application; consequently there is also little 
variation to allow for the estimation of the NBPTS variables in a teacher fixed- effects 
specification. The reason is that the number of NBPTS applicants expanded rapidly during the 
years of our data, so the number of applicants and certified teachers is significantly larger in the 
final year of the data than in any other year, implying few past applicants and certified teachers. 

There are 74,318 teachers in 1997, 76,609 teachers in 1998, and 78,075 teachers in 1999. 

Eor most of the years of data in our study, more than one-quarter of the nation’s NBCTs taught 
in North Carolina. 
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State officials (a statistical analyst at the NCDPI testing office and that individual's 
supervisors) stated that at least 90 percent of the time, the students’ classroom teacher is the 
same person as the one listed on their student record as their “test administrator.” We followed 
up on that information, asking the same question of district- level testing officials. We gathered 
our sample by calling the first 15 districts (in alphabetical order) as well as the 5 districts serving 
the largest metropolitan areas in the state, until we received 10 districts’ responses on the 
question. All 10 responses confirmed that at least 90 percent of the time, the testing 
administrators were indeed also students’ classroom teachers (a list of the districts that provided 
this information is available on request). To minimize any mismatching of student and teacher 
records, we excluded magnet schools from our sample, since state officials indicated that there is 
a reduced likelihood at magnet schools that the teacher listed as the testing administrator on the 
student’s record is in fact that student’s regular teacher. 

9 1 

We retained only teacher test scores that fall into the proper range for each particular test (e.g., 
if the range of possible scores for a test was between 100 and 200, and the recorded score was a 
54, we considered the test to be missing). We replaced missing teacher test scores with the mean 
value for that particular test in order to keep as many observations in our models as possible. 

99 

For teachers with multiple scores for the same test, the most current test score was used. 

9 9 

The most commonly available tests on teacher records are the Praxis II tests, because the state 
of North Carolina began requiring teachers to take and submit their Praxis II exam scores in the 
second half of the 1990s in order to obtain a teacher’s license. Teachers have until June 30 of the 
year that their teaching license is granted to take and report their Praxis II exams. Mean value 
replacement was used when teachers were missing test scores. 

Please see figure 1 in appendix A for a graphical representation of the NBPTS application and 
certification timeline. It should be noted that the length of the entire process varies for 
candidates, depending on when they apply (June through December in the year previous to the 
fall that certification is announced). 

9 S 

Whether a teacher is considered certified upon completion of the assessment requirements or 
after certification announcements have been made could impact the results of the data analyses, 
since it is thought the assessment process can in fact detract from a teacher’s performance due to 
its rigor and time commitment. 

9 ^ 

For more information on how various growth/gain goals and measures are determined by the 
state, see http://www.ncpublicschools.org/accountability/reporting/abc/2002-03/?&print=true 
(11/2/05). 

97 

For specific information on how student and teacher records were merged, please contact the 
authors. 

9 8 

Some students and teachers may appear in our data in multiple years, so we refer to each 
appearance as an “observation.” Some student and teacher do not appear in our data, despite the 
presence of their records. We did not include observations where we were unable to match 
teachers to students. This happened primarily because of coding errors in listing the teacher 
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name on the student’s record. For instance, since we matched student and teacher records by 
teacher name and school code, if teachers’ last names or first names were spelled differently on 
each year’s records, it was not possible to match the information. Matching students across years 
is similarly problematic if data is entered differently between years, making it impossible to 
match multiple- year records of the same student in those cases. 

90 

Of the reading observations, 6,029 student observations have a new or past NBCT and 303 
teacher observations are new or past NBCTs in our data. Of the math observations, 6,048 student 
observations have a new or past NBCT and 303 teacher observations are new or past NBCTs in 
our data. See table B.3 for the distribution of these students and teachers across years and 
grades. 

90 

Unless otherwise noted, the effect sizes reported in this paper are based on the standard 
deviations of the growth in reading (6.14) and math (6.91) scores, for the full sample of students. 

9 1 

Though we do not report them all here, a complete set of coefficient estimates is available 
from the authors upon request. 

All else equal, in reading and math, the one- year test-score growth for white students exceeds 
black students by 10 and 12 percent of a standard deviation respectively; male students exceed 
female students by 2 and 1 percent of a standard deviation, respectively; nonparticipants in the 
free and reduced- price lunch program exceed participants by 4 and 9 percent of a standard 
deviation, respectively; and students without learning disabilities exceed students with learning 
disabilities by 5 and 8 percent of a standard deviation, respectively. 

9 9 

See Hanushek (1986, 1997) and Greenwald et al. (1996) for reviews of this literature. 

The elimination of special education and limited English dependent students from the sample 
reduces the sample size to 565,210 for reading and 565,913 for math. The only changes in results 
for NBPTS variables, reported in table 2, occur in the reading models: In the reduced sample, 
current NBCT is only significant at the 10 percent level in the reading models displayed in 
columns 1 and 2 of table 2, and current applicant is significant at the 10 percent level in column 
4 of table 2. 

9 S 

We are able to match teachers and students through the 1998-99 school year, but we have data 
on teacher certification status through 1999-00. Since we have one more year of information on 
teacher NBPTS certification status than student achievement, our sample of future NBCTs (805 
unique teacher observations) is significantly larger than our sample of current NBCTs (303 
unique teacher observations). 

96 \ 

One might argue that it is more appropriate to use either the standard deviation of student 
gains or the standard deviation of teacher effects (both of which are smaller) as a benchmark to 
measure the size of the NBPTS effects. 

97 

The decrease in the magnitudes of current NBCT and future NBCT is not statistically 
significant in either the reading or math models. 
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A t-test of the difference in the future NBCT and past NBCT coefficients indicates that this 
difference is significant in the math model. 

OQ 

In our sample, there are only 87 unique teachers who are past NBCTs. 

The “Ashenfelter dip” refers to the possibility that estimates of job training programs are 
biased by the fact that trainees typically experience a decline in their earnings (the dip), relative 
to comparison groups, just prior to enrollment in a training program. 

The teacher fixed-effects models account for the possibility that unobservable variables at the 
teacher level might be correlated with teachers’ NBPTS status. 

See appendix table B.2 for details on the number of teachers who fall into each NBPTS 
category. 

A similar pattern exists when we focus on those who are actually certified rather than aU 
applicants. 

We estimated a specification where the post-test score (as opposed to the gain) was regressed 
against the set of controls and school fixed effects and find that only past NBCT changes: it is 
significant at the 1 percent level in this model, as opposed to being significant at the 10 percent 
level in the gains model. 

In addition to this, we estimated a student fixed-effects specification where the post-test score 
(as opposed to the gain) score was regressed against the set of controls. The coefficient estimates 
on the NBPTS variables were quite similar to those reported in columns 6 and 12 of table 2. The 
only difference in the estimates occurs on the estimated coefficient of new NBCT (see column 6 
of table 2), which is positive and statistically significant at the 5 percent level in the reading 
model, whereas it was not statistically significant in the gain specification (though it was 
positive). 

We also estimated more restrictive specifications of the model that included interactions 
between NBPTS status variables and race/ethnicity and lunch status. The results from these 
models reflect the findings we discuss below. 

The “other” race variable consists of students reported to be Asian, Hispanic, Native 
American, mixed, and other in the state data. 

AQ 

Furthermore, the sum of current applicant and new NBCT is positive and statistically 
significant in the 3rd grade reading and math models, implying that having a NBCT in the year 
of application is beneficial for students in that grade. 

One must interpret this finding with caution, as it does not necessarily imply that schools 
would be better off reassigning their NBCTs to teach lower- income students or in earlier grades, 
since teaching skills may not easily be transferable across grades or types of students. 
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